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ABSTRACT 

Objective: To assess the evidence for the claim 
probiotics can correct dysbiosis of the normal 
microbiota resulting from disease or disruptive events. 
Setting: Systematic review of published clinical trials 
of patients receiving a probiotic intervention for the 
prevention or treatment of various diseases. 
Data sources: Sources searched (1985-2013): 
PubMed, EMBASE, Cochrane Database of Systematic 
Reviews, CINAHL, AMED and ISI Web of Science. 
Three on-line clinical trial registries were searched: 
Cochrane Central Register of Controlled trials, 
MetaRegister of Controlled Trials and National 
Institutes of Health. 

Review metliods: Included studies were randomised 
clinical trials of probiotic interventions having 
microbiological assays. Studies were evaluated 
following Preferred Reporting Items for Systematic 
Reviews and Meta-Analyses guidelines for specific 
probiotic strains. A standard data extraction form was 
used to collect the raw data. 
Outcome measures: The primary outcome is the 
degree of microbiota correction by specific probiotic 
strains. Secondary outcome was the association between 
the degree of dysbiosis correction and clinical efficacy. 
Results: The review of the literature found three 
distinct study designs: model A (restoration) assayed 
patients enrolled with a healthy, undisturbed 
microbiota and then assayed postdisruptive event and 
probiotic therapy; model B (alteration) assayed patients 
with pre-existing disrupted microbiota and then 
postprobiotic therapy; model C (no dysbiosis) assayed 
volunteers with no disruptive event prebiotic and 
postprobiotic. From a total of 63 trials, 83% of the 
probiotic products using model A restored the 
microbiota, 56% using model B improved the 
microbiota and only 21% using model C had any effect 
on microbiota. Clinical efficacy was more commonly 
associated with strains capable of restoration of the 
normal microbiota. 

Conclusions: The ability to assess the degree of 
dysbiosis improvement is dependent on the enrolled 
population and the timing of microbiological assays. 
The functional claim for correcting dysbiosis is poorly 
supported for most probiotic strains and requires 
further research. 

Trial registration number: PROSPERO 
(CRD4201 4007224). 



Strengths and limitations of this study 



■ A comprehensive review of the published litera- 
ture from 1985-2013. 

■ Literature search unrestricted by language or 
country. 

■ Analysis of study designs resulted in novel strat- 
egy to limit bias and classify outcomes. 

■ Three types of outcomes of dysbiosis applied to 
evidence-based studies of specific probiotic 
strains. 

■ Author has over 30 years of research experience 
in the probiotic field. 

■ Pooled clinical trials using different study 
populations. 

■ Pooled probiotic doses and regimens. 

■ Indirect evidence linking probiotic strains and 
dysbiosis. 

■ Review performed by sole author. ^^^^^^ 
INTRODUCTION 

The popularity of probiotics has expanded 
exponentially recently but along with their 
increased use, debate rages on how probio- 
tics should be regulated and whether probio- 
tics should be considered as a medical food, 
drug or a food supplement. In the USA, pro- 
biotics are typically available as dietary sup- 
plements and thus are limited to 'structure 
or function' health claims and, unlike pre- 
scription drugs, are not permitted to claim 
to 'treat' or 'cure' disease. In Europe and 
the UK, probiotics are allowed to have health 
or function claims. These claims are 
required to be supported by well-conducted 
human trials in the targeted population or in 
healthy volunteers, but the European Food 
Safety Authority (EFSA) has rejected >80% 
of claims submitted to them.^~^ In many 
cases, scientific substantiation of a specific 
health claim was judged insufficient or based 
on an indirect effect.^ One such functional 
claim made for probiotic products is they 
correct dysbiosis (or the disruption of bacter- 
ial and fungal species after antibiotics or 
other disruptive exposures) and thus may be 
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beneficial to maintain health. Probiotics are active 
during this susceptible window fi:'om the time of the dis- 
ruptive event to the time when normal microbiota is 
restored. A wide variety of mechanisms-of-action have 
been documented for probiotics (ranging from blocking 
pathogen attachment sites, destruction of the pathogen 
by bacteriocins or proteases that degrade toxins, to regu- 
lation of the immune system),^ ^ and while clinical evi- 
dence supports efficacy of some probiotic strains, the 
evidence linking these mechanisms-of-action to a spe- 
cific health or function claims is not as clear. 

A classic example of the consequence of dysbiosis is 
antibiotic-associated diarrhoea (AAD).^ ^ While antibio- 
tics may be effective in the elimination of pathogenic 
organisms, a common, unintended effect is the killing 
or inhibition of beneficial microbes due to shared sus- 
ceptibility to the antibiotic. One of the many functions 
for normal microbiota is the ability to resist infection by 
pathogenic organisms, termed 'colonisation resist- 
ance'.^ The loss of a subpopulation of the normal 
microbiota, for example, can lead to the loss of the 
ability to break down fibres and starches into absorbable 
short chain fatty acids, resulting in high level of 
undigested carbohydrates, which can trigger diar- 
rhoea.^^ Disruption of the normal microbiota has been 
shown to lead to higher rates of infections in other body 
systems other than the intestinal tract including the 
skin,^^ vagina,^"^ respiratory tract,^^ and in the 
buccal cavity. 

The major challenge to establishing a cause and 
effect for the improvement of dysbiosis by probiotics is 
a lack of a standard definition of 'normal' microbiota. 
There is substantial inter-individual variation of the 
species of microbes present at different body niches, 
which also varies by age, geographic area and health 
status of the host. In addition, a complete accounting 
of the microbiota is currently impossible, as there are 
no assays to detect all of >10^^-10^'^ organisms in the 
intestines and standard microbial culturing methods 
miss 75-95% of these organisms. The development 
of metagenomics (cataloguing individual and disease- 
specific bacterial gene profiles) and the creation of the 
international Human Microbiome Project ushered in a 
new era for our understanding of the complexity of 
these interactions within the body.^^ This paradigm 
shift from culturing to metagenomic analysis has 
expanded our ability to document shifts in microbial 
populations to an unparalleled degree, but the inter- 
pretation of these shifts continues to be under 
debate. With the advent of these newer metage- 
nomic tools, the role of probiotics in the restoration of 
normal microbiota is being revisited.^^ 

In light of new guidance documents and recommen- 
dations, the goal of this systematic review is to determine 
how claims for the restoration of the normal microbiota 
and the correction of dysbiosis have been studied using 
well-designed trials and which probiotic strains have 
evidence-based data to support these claims. 



METHODS 
Study objective 

To systematically review the literature to analyse the evi- 
dence for the claim probiotics can correct dysbiosis of 
the normal microbiota from randomised controlled 
trials. 

Search strategy 

Search terms included: probiotics+health claims, restor- 
ing normal microbiota, dysbiosis, normal microbiota, 
pharmacokinetics, metagenomics, probiotics, dietary 
supplements, randomised controlled trials, AAD, 
Clostridium difficile infection (GDI), inflammatory bowel 
disease (IBD), irritable bowel syndrome (IBS), traveler's 
diarrhoea (TD), eradication of Heliobacter pylori, bacterial 
vaginosis (BV) or vaginitis, treatment of acute paediatric 
diarrhoea and specific probiotic strains or products. 
Search strategies were broad-based initially, then nar- 
rowed to clinical trials with probiotics. 

Data sources 

PubMed (1985-2013), EMBASE (1985-2013), Cochrane 
Database of Systematic Reviews (1990-2013), CINAHL 
(1985-2013), AMED (1985-2013) and ISI Web of Science 
(2000-2013). Three on-line clinical trial registries were 
searched: Cochrane Central Register of Controlled trials 
(http://www.cochrane.org), MetaRegister of Controlled 
Trials (http:www.controlled-trials.com/mrct) and National 
Institutes of Health (http:/ / www.clinicaltrials.gov) . 

Criteria for study selection and data extraction 

Abstracts of all citations were reviewed by a single author 
and rated for inclusion for randomised controlled trials 
of probiotic treatments. Full articles were retrieved if 
normal microbiota assays were mentioned. Non-English 
language trials were translated and included whenever 
possible. Exclusion criteria included preclinical studies 
(animal models or in vitro assays), safety or phase 2 
studies, reviews, efficacy trials with no assays for normal 
microbiota species, metagenomic methods only, mech- 
anism of action of normal microbiota or probiotic, cross- 
sectional surveys, case reports or case series, duplicate 
reports or trials of unspecified types of probiotics. All 
pharmacokinetic studies in humans were reviewed, as 
abstracts often did not include normal microbiota assay 
data. Data extraction and the review process followed 
the Preferred Reporting Items for Systematic Reviews 
and Meta-Analyses (PRISMA) statement guidelines using 
a 27-item checklist and flow diagram. A standardised 
data extraction form was used to collect data on the pro- 
biotic (strain type, daily dose, duration), type of controls 
(placebo, active or no treatment), study design (status of 
microbiota at baseline and follow-up times), type of 
microbiota assay (microbial culturing, molecular biomar- 
kers, etc), enrolled study population (adult vs paediatric, 
healthy volunteers, disease condition), type and timing 
of disruptive agent (antibiotics, chemotherapy, etc), 
study size and attrition, outcome assessment (efficacy 



2 



McFarland LV. BMJ Open 2014;4:e005047. doi:1 0.11 36/bmjopen-201 4-005047 



6 



Open Access 



and/ or microbiota status at end of study, adverse events) 
and type of health claim. 

Outcomes and definitions 

The primary outcome is the degree of microbiota cor- 
rection or improvement by specific probiotic strain (s). 
The secondary outcome is the association between the 
degree of dysbiosis correction and the net efficacy found 
from randomised controlled trials of probiotic interven- 
tions. Dysbiosis is defined as an alteration or disruption 
of the normal microbiota (bacterial or fungal species) 
due to exposure of an disruptive factor (such as antibio- 
tics, chronic disease, stress, medical procedures or medi- 
cations, etc). As there is no current standard definition 
of 'normal' microbiota, for this review, restoration of 
normal microbiota is defined as a return to the assayed 
microbial species or profile taken from a healthy individ- 
ual (before a disruptive event has occurred). Included 
studies are required to have at least a preprobiotic treat- 
ment assay and a postprobiotic treatment assay. A variety 
of microbial assays were available during the search 
period (1985-2013), including documentation of the 
microbiota by either microbial cultures or metagenomic 
methods (16s rRNA-targeted probes using fluorescent in 
situ hybridisation (FISH) or other PGR technique)^ 
or by indirect methods (Nugent scores). Nugent 
scores (ranged 0-10) are used to diagnose bacterial 
vaginosis (scores >7) or normal vaginal microbiota 
(scores 0-3) based on the quantitated morphotypes of 
small Gram-negative rods (Gardnerella vaginalis /hacteroides 
spp) and curved Gram-negative rods {Mobiluncus spp) 
from Gram stains of vaginal discharge smears. Microbial 
assays of only the strain (s) contained in the probiotic 
product are considered as pharmacokinetic studies and 
were not included in the normal microbiota profiles. 

Models of dysbiosis 

To determine the impact on normal microbiota, only 
direct evidence of microbiota change (species, profiles, 
diversity indices or diagnostic criteria) were included 
and indirect effects were excluded (changes in intestinal 
enzymes, immune system parameters or disease symp- 
toms). The degree to which dysbiosis was improved is 
categorised into three levels: (1) recovery of the normal 
microbiota back to baseline levels; (2) alteration or 
improvement of the normal microbiota; and (3) no 
change in normal microbiota. 

The literature contained three dysbiosis models: 
model A (restoration of the normal microbiota), which 
assayed patients enrolled with a healthy, undisturbed 
microbiota and then assayed again after a disruptive 
event (such as antibiotic exposure) and probiotic 
therapy occurred; model B (alteration of the micro- 
biota) assayed patients with pre-existing disrupted micro- 
biota (eg, pre-existing chronic disease or active disease) 
and then post-probiotic therapy; model G (no dysbiosis) 
assayed volunteers with no disruptive event (before or 
during the clinical trial) at both preprobiotic and 



postprobiotic times, as shown in figure 1. 'Recovery' of 
the normal microbiota is defined as a restoration of the 
microbiota back to a normal healthy baseline. Recovery 
may be complete recovery (all assayed microbial levels 
returned to baseline) or incomplete recovery (partial 
recovery of some microbial strains, but not all returned 
to baseline levels). In studies enrolling participants with 
dysbiosis at baseline (typically due to chronic diseases), 
it is not possible to show a restoration to normal micro- 
biota levels because a normal, undisturbed microbiota 
was not present in these types of study participants at 
the time of enrolment. Therefore, the strongest claim 
possible for model B designs is for an 'alteration or 
improvement' of the microbiota. Only data from the 
probiotic-exposed participants were analysed in this 
paper. Data from the control groups were used to 
confirm dysbiosis for participants with chronic diseases 
or after a disruptive exposure, such as antibiotics or 
chemotherapy, unaffected by probiotic exposure. ^^"^"^ 

Assessment of methodological strength and quality 

The GRADE (Grading of Recommendations, Assessment, 
Development and Evaluation) system for rating overall 
study quality will be used for each probiotic strain or 
type (single strains and mixtures of strains). 
Recommendation for the support of the claim of each pro- 
biotic strain or mixture can be assessed by the overall 
strength of the evidence ('strong', many randomised con- 
trolled trials show significant recovery of the microbiota or 
'moderate' only one randomised controlled trial; or 
'weak', only case series or reports, limited number of small 
trials, etc). 

Quality of the evidence is based on study design and 
graded as 'high quality' (well-defined study design for 
determining restoration with normal microbiota, model 
A), or 'moderate quality' (disrupted microbiota at base- 
line, model B), or 'low quality' (no disruptive event 
occurred, model G). Measurement of publication bias 
was not assessed for this review, as pooled outcome esti- 
mates of efficacy were not carried out, as typical in 
meta-analysis, but all studies with assays of microbiota 
were included to limit bias. 

Net efficacy rating 

To determine if the ability to correct dysbiosis is asso- 
ciated with clinical efficacy, the published literature for 
randomised controlled trials (RGTs) or meta-analyses of 
probiotics for various disease indications, including 
AAD,^ 36 37 5 38 jgj^ 39 40 41 eradication of 

36 3*7 742 

H. pylori, Bv and treatment of acute paediatric 
diarrhoea was reviewed.^^"^^ The net rank was calculated 
by subtracting the number of RGTs showing non- 
significant or equivalent efficacy from the number of 
RGTs having significant efficacies. The ranks were cate- 
gorised as follows:++, >2 net RGTs showing significant 
efficacy;+, net of one RGT showing significant efficacy; 0, 
equal number of RGTs showing significant and non- 
significant efficacy results and — , >1 net negative or non- 
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Time sequence of events 



1^ . - ^(1 

Normal microbiota Disrupted microbiota Recovered or improved 

normal microbiota 



antibiotics, 
chemotherapy, 
or disease 



^ Probiotic ^ 



Model 


Type of 


Dysbiosis 


Time 


Probiotic or control 


Potential 




population 


at baseline 


microbiota 


intervention 


outcomes 




enrolled 




disrupted 






A 


Healthy 
volunteers or 
at-risk 
patients 


no 


post-baseline 


preventive 


restoration 


B 


Patients with 
active disease 
at enrollment 


yes 


pre-baseline 


treatment 


altered or 
improved 


C 


Healthy 
volunteers 


no 


not disrupted 


preventive 


altered 



Figure 1 Time sequence of events and three models of study designs determining three different degrees of dysbiosis 
correction by probiotics. 



significant RCTs. Probiotics with no RCTs were not 
ranked. 

RESULTS 

A review of the literature from 1985-2013 found 353 
articles that dealt with probiotic treatments and their 
potential effect on normal microbiota. 

Excluded studies 

As shown in figure 2, a total of 272 articles were excluded 
for the following reasons: reviews (n=116), probiotic effi- 
cacy studies with no data on normal microbiota assays 
(n=54) , animal models of probiotics and changes in micro- 
biota (n=38), metagenomic or microbiota methods only 
(n=l7), studies on normal microbiota but with no use of 
probiotics (n=14), in vitro assays of microbiota (n=10), 
duplicative reports (n=2) or miscellaneous (n=21), which 
included probiotic mechanism of action studies, safety 
studies, duplicative reports, cross-sectional surveys and two 
with poorly described probiotic interventions.^^ A total 
of 81 full articles were reviewed which mentioned changes 
in normal microbiota or indicated a health claim for pro- 
biotics and effects on normal microbiota. 

Probiotic pharmacokinetic studies (n=18) reporting 
concentrations of probiotic strains before and post- 



treatment, but not assaying for other species of normal 
microbiota were excluded. While several studies using 
this study design claim probiotics had an impact on 
normal microbiota, type of data generated is pharmaco- 
kinetic behaviour of the probiotics themselves and not 
the normal microbiota. Several studies stated that the 
normal microbiota was altered because an increase in 
various bacterial species was observed after the probio- 
tics were given, but the species assayed were those con- 
tained in the probiotic product, so an increase is not 
unexpected. Pharmacokinetic studies have documented 
that probiotic strains taken orally can survive transit 
through the intestinal tract with recovery rates in faeces 
ranging from <1% to 22%.^^ These pharmacokinetic 
studies were excluded from this analysis, as they did not 
assay other types of normal microbiota not found in the 
probiotic product. 

Included studies 

Of the 63 included clinical trials, five trials had multiple 
treatment arms, which resulted in a total of 69 treatment 
arms for analysis. Engelbrektson et a^^ tested a mixture 
of five probiotic strains in volunteers exposed to antibio- 
tics and also tested a mixture of four probiotic strains in 
healthy volunteers with no antibiotic exposure. Zoppi 
et at^ had eight different treatment arms in his study. 
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Records by database 
search (n=346) 



Other sources 
(n=7) 



Screened abstracts 
(n=351) 



Excluded duplicates (n=2) 



Full articles evaluated 




(n= 


81) 


> 


\ 


( 





Pre- and Post-probiotic 
intervention assays done 
(n=63) 



Excluded: Reviews, no nornnal 
microbiota assays, pre-clinical, 
mechanism-of-action studies, 
safety studies, etc. (n=270) 



Excluded: kinetic studies of 
probiotic only (n=18) 



Model A: 

Undisrupted normal flora at 
baseline, followed by inciting 
disruption, followed by 
probiotic. 

(n=10 trials, 15 treatment arms) 



Model B: 

Disrupted normal flora at 
baseline due to chronic 
disease or conditions 
(n=24 trials, 25 treatment 
arms) 



Model C: 

No dysbiosis. 
Undisrupted normal 
flora throughout trial 
(n=29 trials, 29 
treatment arms) 



Figure 2 Flow chart of literature review results (1985-2013) of included and excluded studies for the restoration or improvement 
of normal microbiota by probiotics. RCT, randomised-controlled trials; MOA, mechanism of action; NM, normal microbiota. 



and probiotic arms were included in our analysis 
{Saccharomyces houlardii alone and Lactobacillus rhamnosus 
GG alone), a mixture of two probiotics (L. acidophilus 
and Bifido bifidum) and a mixture of three probiotic 
strains (L. acidophilus, L. rhamnosus and B. bifidum). 
Orrhage et af^ had two treatment arms {Bifido longum 
alone and a mixture of B. longum and L. acidophilus). 
Larsen et af^ tested two single probiotics {B. lactis and 
L. acidophilus) in separate treatment arms. Lidbeck 
et af^ gave either enoxacin or clindamycin and rando- 
mised patients to either L. acidophilus or placebo. 

Normal microbiota assay methods 

Of the 69 treatment arms that did normal microbiota 
assays, diverse methods were used to profile the micro- 
biota. Many studies used only standard microbiological 
culture assays (37, 54%), while others (28, 40%) used 
techniques to detect non-cultivatable bacterial strains, 
which included metagenomic assays (FISH, TRFLP, 16 s 
rRNA sequencing) or other PGR techniques. Some 
studies (4, 6%) used an indirect measure of normal 
microbiota, using the Nugent score to diagnose bacterial 
vaginosis, which relies on Gram stain of the vaginal 
secretions, vaginal pH and symptoms to characterise if 
normal microbiota is present or absent. 



Probiotic strains 

In the 69 treatment arms, most (36, 52%) used a single 
strain of probiotic, while 14 (20%) tested a mix of two 
probiotic strains and 19 (28%) tested a mix of three or 
more probiotic strains. The distribution of single versus 
multiple strain probiotics did not significant vary by the 
model of study design (;t|=2.3, p=0.32). Of the 15 
restorative (model A) study arms, 47% used a single 
strain of probiotic and 53% used multiple strains. Of the 
25 treatment arms with disrupted microbiota at baseline 
(model B), 44% used a single strain and 56% used mul- 
tiple strains. Of the 29 study arms with undisrupted 
microbiota (model G), 62% used a single strain and 
38% used multiple strains. 

Normal microbiota restoration model (model A) 

Only 10 studies (with 15 treatment arms) using model A 
to determine restoration of the microbiota were found 
(table 1).^^ ^^-^^ ^^^^ The type of enrolled partici- 
pants varied from healthy volunteers to children with 
untreated respiratory infections, to paediatric cancer 
patients. For participants with acute infections or cancer, 
baseline assays were performed prior to the disrupting 
agent (antibiotics or chemotherapy). The number of 
participants given probiotics averaged 20/study and 
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ranged from 5 to 83. In 93%, the disruptive factor was 
antibiotic exposure and in one study, chemotherapy 
caused the microbiota disruption. Only 8 (53%) of the 
study arms did an assay during a 1-8 weeks follow-up 
period after the probiotic was discontinued. 

Analysis of the probiotic strain (s) separately found only 
two probiotic products with more than one randomised 
controlled trial. The probiotic mix of L. acidophilus and 
B. bifidum showed a complete restoration in one study, 
but only a partial recovery in the other (Strength: 
strong. Quality: high). The probiotic mix of L. acidoph- 
ilus (2 strains) with B. bifidum and B. animalis showed 
complete restoration in one study, but only a partial 
recovery in the other (Strength: strong. Quality: high). 
Five other probiotic products with only one supporting 
clinical trial showed microbiota restoration {B. longum, 
Clost. butyricum, L. acidophilus, mix of L. acidophilus with 
L. paracasei and B. lactis and the mix of L. acidophilus 
with L. paracasei and B. bifidum and two strains of 
B. lactis; Strength: moderate. Quality: high). Three pro- 
biotic products with one supporting clinical trial showed 
partial restoration {S. boulardii, L. rhamnosus GG, mix of 
L. rhamnosus with L. bifidus and L. acidophilus:, Strength: 
moderate. Quality: high). Only two probiotic products 
using Model A showed no change in the microbiota 
{B. breve and a mix of L. acidophilus and B. longum; 
Strength: moderate. Quality: high). In summary, 10 of 
12 (83%) of the probiotic products showed complete or 
partial restoration of the normal microbiota. 

Of the 11 probiotic products with claims of 'restores 
or improves normal microbiota', 10 (91%) were sup- 
ported by this review, but only seven showed complete 
restoration and five had partial restoration of the micro- 
biota (table 1). The mixture of L. acidophilus and 
B. longum did not show any changes in the microbiota. 
Wada et aP^ claimed B. breve 'enhanced intestinal anae- 
robes', but this was only compared to the placebo 
group. Their data showed chemotherapy is a disruptive 
event, resulting in more enterobacteria in the intestine 
in the placebo group, but there were no significant dif- 
ferences seen by the end of the 8 weeks follow-up in 
either the probiotic or the placebo group compared to 
baseline microbiota levels. 

Disrupted normal microbiota at baseline studies (model B) 

Twenty-four studies (with 25 treatment arms) used 
model B that enrolled participants with a pre-existing 
disrupted microbiota related to ongoing disease or con- 
ditions (table 2). The number of participants 

given probiotics averaged 23±16/study and ranged from 
7 to 83 participants. The types of pre-existing factors 
that disrupted the microbiota included atopic dermatitis 
patients, allergies, cirrhosis, bacterial vaginosis, irritable 
bowel syndrome, inflammatory bowel disease (ulcerative 
colitis and pouchitis), idiopathic diarrhoea, enteral 
feeding, short-bowel syndrome and colon cancer. Only 
10 (40%) of the study arms did an assay during the post- 
probiotic follow-up period. 



Three of the probiotics had multiple clinical trials to 
support the claim of an improvement in the microbiota 
due to the probiotic. S. boulardii was used in two trials 
either with enteral fed patients or patients with active 
diarrhoea and found an improvement in the habitual 
microbiota in the patients with active diarrhoea,^^ but 
only showed indirect evidence of short-chain fatty acid 
changes in the other study^^ (Strength: strong. Quality: 
moderate). A mix of four probiotic strains (2 strains of 
L. rhamnosus, P. freudenreichii+B. breve) showed improved 
microbiota in two clinical trials^^ (Strength: strong. 
Quality: moderate). Of four clinical trials testing a 
mixture of seven probiotic strains, two showed no simifi- 

77 78 

cant change in microbiota, one showed more anae- 
robes postprobiotic treatment^^ and one found a 
reduction in bacteroides species^^ (Strength: strong. 
Quality: moderate). Three clinical trials determined 
there were no significant changes due to Lactobacillus 
plantarum 299v^^~^^ (Strength: strong. Quality: moder- 
ate). Of those probiotics with only one supporting clin- 
ical trial (Strength: moderate. Quality: moderate), two 
single probiotic strains {E. coli Nissle and L. casei rhamno- 
sus) and five different mixtures of probiotic strains 
support the claim that the probiotic alters the micro- 
biota (table 2). In summary, 10 of 18 (56%) probiotic 
products altered or improved microbiota in individuals 
with pre-existing disease. 

Of the 25 treatment arms, the paper's claim was con- 
firmed in 14 (56%) of the studies. There was no signifi- 
cant change in the microbiota due to the probiotic in 
nine treatment arms and only an alteration of the micro- 
biota in five others (table 2). Our review disagreed with 
the claimed outcomes in 11 (46%) of the other treat- 
ment arms. In seven treatment arms, it was claimed the 
tested probiotic 'restored normal microbiota', but it is 
uncertain how this conclusion was reached, since there 
was no time when a normal undisrupted microbiota was 
present. Of the seven studies that claimed their probiotic 
'restored' normal microbiota, our analysis determined 
none were capable of documenting restoration, but it is 
confirmed probiotics improved or altered the microbiota 
in these studies. Four studies claimed the probiotic 
'altered or improved' normal microbiota, but this review 
found no significant differences when postprobiotic and 
baseline assays were compared for the probiotic groups. 
Girard-Pipau et aP concluded that S. boulardii 'altered 
normal flora' because more Gram-positive anaerobes 
were seen in the probiotic group compared to the con- 
trols and an increase in three short-chain fatty acids 
were observed in the S. boulardii group. However, when 
the analysis is restricted to trends observed in the pro- 
biotic group only, no significant differences were 
observed in preprobiotic versus postprobiotic microbiota 
profiles. Venturi et aP concluded that the mix of seven 
probiotic strains enhanced the concentration of some 
beneficial strains in the intestines. However, the only 
strains having a significant increase were those con- 
tained in the probiotic mix, and not specifically normal 
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Pjable 1 Evidence-based data for restoration of normal microbiota (NIVI) for 12 probiotics from 10 studies (15 treatment arms; model A) 
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^able 2 Evidence-based data for improvement or alteration of normal microbiota (NM) in 18 probiotics from 24 studies (25 treatment arms) with disturbed microbiota at 
baseline (model B) 
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microbiota of the host. As this study did not have an 
undisturbed microbiota baseline, the increased numbers 
of lactobaciUi and bifidobacteria may not have reflected 
their normal levels. Van der Aa et at^ claimed that 
B. breve 'successfully modulates the intestinal flora', but 
no significant changes were observed in the probiotic 
group when comparing the baseline to the postprobiotic 
levels. Odamaki et af^ did show an increase in 
Faecalihacterium spp and Bacteroides fragilis spp at the end 
of B. longum BB536 treatment, but the same increase was 
also observed in the placebo group. 

Undisrupted normal microbiota studies (model C) 

Twenty-nine trials enrolled healthy adults who had no 
disruptive factor present during the study (either no 
antibiotic or no medication exposure or presence of 
acute or chronic disease) that might impact normal 
microbiota, as shown in table 3.^^ ^^'^^^ The 

average number of participants given probiotics was 23/ 
study and ranged from 7 to 160/study. Of the 29 study 
arms, assays were taken during a follow-up period in 
only 52%. Fujiwara et aP"^ cultured seven healthy volun- 
teers and found enterobacteriaceae and Clostridial 
species post-5, longum was reduced by 10^/g compared 
to baseline (p<0.03), but no other changes in the micro- 
biota were detected. Karlsson et aP^ found a significant 
increase in intestinal diversity in nine male volunteers 
with atherosclerosis given L. plantarum 299v, but because 
terminal restriction fragment length polymorphism 
assays were used instead of cultures for bacterial species, 
the specific changes in the microbiota species could 
not be determined. Yang and Sheu cultured 63 chil- 
dren (55% with Helicobacter pylori) given a yogurt with 
L. acidophilus and B. lactis but only found a decrease in 
E. coli counts in the H.pylori negative children subgroup, 
no significant changes in normal microbiota was found 
in the H. pylori-positive children. Kubota et al^^^ 
assayed 29 participants with Japanese cedar pollen 
allergy and found milk fermented with L. rhamnosus GG 
and L. gasseri TMC0356 suppressed microbiota changes 
(less intestinal profile changes), but could not deter- 
mine specific bacterial species changes due to the type 
of assay used (FISH and TRFLP).^^^ In summary, only 4 
of 19 (21%) probiotic products altered microbiota in 
healthy individuals who had no disruptive event. 

Of the seven studies that claimed their probiotic (s) 
'restored or altered' the normal microbiota, only four 
claims were confirmed. Sierra et aP^ claimed Lactobacillus 
salivarius given to 20 healthy adults 'improved gut micro- 
biota', but only increased levels of Lactobacilli were found 
and no other changes in normal microbiota species were 
detected. The only other evidence was indirect from 
changes observed in immune parameters. He et aP^ 
claimed a mixture of B. longum and B. animalis 'modified' 
microbiota, but changes were seen only during the yogurt 
administration and not after the 1 week follow-up period. 
Vitali et al^"^ claimed that the mixture of four lactobacilli 
strains and three bifidobacteria strains 'modulated vaginal 
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Table 3 Model C: Evidence-based data for improvement or alteration of normal microbiota (NM) in 19 probiotics in healthy volunteers enrolled in 29 studies (29 treatment 
arms) in studies with no disruptive exposures 

Number Type of Type of 
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^able 3 Continued ^ 



Probiotic* 
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treated with 
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NIVI 
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FISH, fluorescence in situ hybridisation analysis; TRFLP, terminal restriction fragment length polymorphism analysis. 
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microbiota', but the only significant changes were due to 
an increase in the bacterial species contained in the pro- 
biotic mixture. 

Of the probiotics supported by multiple clinical trials 
(B. animalis, B. longum, L. casei, L. plantarum 299v, the 
mixture of B. animalis and B. lactis), 13 of the trials 
(87%) support there is no significant change in normal 
microbiota if the microbiota is not disrupted (Strength: 
strong, Quality: low). 

Association of clinical efficacy and normal microbiota 
restoration 

Few studies concurrently compared clinical efficacy and 
the ability to restore or improve normal microbiota after 
dysbiosis. A synthesis of the literature of RCT for eight 
common disease indications was performed and the 
overall net strength was ranked. Probiotics with the 
ability to restore normal microbiota were frequently sup- 
ported by RCTs for efficacy, as shown in table 4. Of the 
10 probiotics with evidence for restoration, 7 (70%) also 
had at least one RCT testing for at least one of the eight 
diseases, while 30% did not have any supportive RCTs 
for efficacy. Of the seven probiotics with associated 
RCTs, only two probiotics {S. boulardii and L. acidophilus) 
have strong evidence for efficacy across most of the 
disease indications, while five probiotics with the ability 
to restore the microbiota had weak or no evidence of 
efficacy. For example, S. boulardii, which has studies sup- 
porting restoration, has strong evidence for clinical effi- 
cacy for AAD (ranked++: 11 RCTs had significant results 
and 6 had non-significant results), CDI (ranked++: had 
two RCTs with significant results), IBD (ranked++: had 
two RCTs with significant results), IBS (ranked 0: had 
one RCT with significant efficacy and one RCT with non- 
significant results), TD (ranked+: 3 RCTs with significant 
efficacy and 2 with non-significant efficacy), H. pylori 
eradication (ranked — : 2 RCTs with significant results 
and 4 with non-significant results) and no studies for BY 
L. acidophilus, which partially restored the microbiota in 
a study, is associated with clinical efficacy for AAD, IBS 
and BV, but not for TD or eradication of H. pylori and 
treatment of acute paediatric diarrhoea (ranked++: had 
19 RCTs with significant protection and five with non- 
significant results) . In contrast, L. rhamnosus GG, another 
probiotic capable of restoring microbiota, is often cited 
in meta-analysis as having significant efficacy for AAD. 
Our results of an updated review of the literature indicate 
a net weak evidence rating for clinical efficacy across all 
disease indications: AAD (ranked — : 3 RCTs had signifi- 
cant results and 6 had non-significant results), CDI 
(ranked — : two RCTs with non-significant results), IBD 
(ranked — : one RCT with non-significant results), IBS 
(ranked 0: 2 RCTs with significant efficacy and two RCTs 
with non-significant results), TD (ranked 0: one RCT with 
significant efficacy and one with non-significant efficacy) , 
H. pylori eradication (ranked -: 3 RCTs with non- 
significant results), no RCTs for BV and treatment of 



acute paediatric diarrhoea (ranked++: 10 RCTs with sig- 
nificant efficacy and one with non-significant findings) . 

Efficacy trials were not carried out as frequently for 
probiotics shown to only have the ability to alter or 
improve, but not restore, the microbiota after dysbiosis. 
Of nine probiotics that can alter the microbiota, 6 
(67%) have supporting RCTs for at least one disease, 
but the diversity of investigated diseases was more 
limited. L. casei had moderate net strength for AAD and 
bacterial vaginosis, but was neutral for the ability to 
eradicate H. pylori and other disease indications were 
not tested in RCTs with L. casei. The probiotic mixture 
of L. reuten and L. fermentum has strong evidence for bac- 
terial vaginosis, but not for any other disease indications 
listed in table 4. 

Of the eight probiotics not capable of altering or restor- 
ing normal microbiota, only L. plantarum 299v had RCTs 
for AAD and IBS, both with net negative or weak strength 
of clinical efficacy. B. lactis and the mixture of L. rhamnosus 
and L. reuten had net neutral rankings for efficacy for the 
treatment of acute paediatric diarrhoea. The other four 
probiotic products with no effect on normal microbiota 
lacked any RCTs for clinical efficacy. Studies with Bacillus 
clausii did not assay for normal microbiota and had non- 
significant trial results for H. pylori eradication and the 
treatment of paediatric diarrhoea. 

Of the six probiotics with only pharmacokinetic data 
on the probiotic itself and no other investigation of 
other normal microbiota strains, five had RCTs showing 
varying net efficacies for different disease indications, as 
shown in table 4. 

Six popular probiotics {B. clausii, B. infantis, L. reuten, 
L. acidophilus+L. helveticus, L. acidophilus+L. casei and 
L. acidophilus+B. animalis) have only clinical efficacy 
RCTs, but have not published studies investigating their 
role in restoring or improving the normal microbiota. 

DISCUSSION 

Developing and evaluating health or function claims for 
probiotics is an important issue and is now identified as a 
priority for research by several international organisa- 
tions, including the World Gastroenterology 
Organization^^^ and the American Society for Nutrition.^ 
The US Food and Drug Administration has struggled 
with appropriate evidence-based health claims for pro- 
biotic products and currently recommends the use of 
structure/function claims, such as 'maintains bowel regu- 
larity', but the claim for restoring normal microbiota is 
still under debate. The European Food Safety 
Authority (EFSA) provides guidance materials that rec- 
ommend health or function claims for probiotics should 
have beneficial physiological effects and have appropriate 
scientific trials to substantiate the health claims.^ 
Acceptable claims for intestinal health may include func- 
tional claims (improved transit time, softer stool consist- 
ency, reduction in gastrointestinal discomfort, defense 
against pathogens). As it is currently not possible to 
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define a standard normal microbiota profile, the EFSA 
recommends functional claims for the restoration of 
normal microbiota should document a recovery of 
healthy microbiota and be accompanied by a beneficial 
physiological or clinical outcome.^ In addition, because 
the efficacy and mechanisms are strain-specific and may 
vary by probiotic strain, the evidence must be analysed 
for each probiotic product individually.^ ^ ^ 109-112 

An underappreciated finding was the influence that 
study design and study populations have on the inter- 
pretation of study outcomes. In the literature, five differ- 
ent types of study designs are commonly found relating 
to probiotics. The most common study type is a rando- 
mised controlled trial testing the efficacy and safety out- 
comes in patients, but these trials did not typically 
document the impact of the probiotic on the normal 
microbiota. The second most common type of study 
design is pharmacokinetic studies (documenting recov- 
ery of oral dose of probiotic or increase in probiotic 
strains post-treatment compared to pretreatment or 
clearance of the probiotic). Even though these kinetic 
studies did not assay for non-probiotic strains, some 
extrapolated their results and concluded some effect or 
improvement of the normal microbiota was observed by 
their probiotic. These two first types of study 
designs do not support evidence-based conclusions for 
the restoration or alteration of the normal microbiota 
and were excluded from this review. 

Three types of study designs are appropriate for the 
study of dysbiosis. The first type of study design had 
normal microbiota assayed at least twice (at baseline, 
which was before exposure to a disruptive event or pro- 
biotics and then again during or postprobiotic treat- 
ment) to show actual recovery of assayed normal 
microbiota back to healthy baseline levels. The second 
type of study design started with inappropriate baselines 
(baseline samples taken after normal microbiota had 
been disrupted by chronic disease). For patients with 
established chronic diseases, there is no 'normal micro- 
biota' baseline in either the probiotic or the control 
group. Even if baselines are taken during remission, the 
microbiota may still be impacted by chronic disease or 
acute diarrhoea. Studies of probiotics in chronic diseases 
or acute disease typically report on 'pre-probiotic treat- 
ment' and 'post-probiotic treatment' and may show sig- 
nificant shifts in microbial species, but it is uncertain if 
this reflects a true re-establishment of normal micro- 
biota profiles. The third type of study design enrolled 
healthy volunteers, who were not challenged with anti- 
biotics (so no normal microbiota disruption occurred) 
and show only the effect of probiotics on a healthy 
microbiota (typically mild or no effects). Control groups 
were not required for our assessment of the impact of 
probiotics on microbiota, but control groups can docu- 
ment the degree normal microbiota is disrupted by incit- 
ing agents (antibiotic, disease onset, etc). 

Five single strain probiotics {B. longum, Clost. butyricum, 
L. acidophilus, L. rhamnosus and S. boulardii) and five 



probiotic mixtures ((L. acidophilus+B. bifidum), (L. rham- 
nosus+L. bifidus+L. acidophilus), (L. acidophilus+L. paraca- 
sei+B. lactis), (L. acidophilus, 2 strains, B. bifidum, 
B. animalis) and (L. acidophilus+L. paracasei+B. bifidum+2 
strains of B. lactis)) documented either complete or 
partial recovery of normal microbiota (model A). Only 
two probiotic mixtures ((2 strain mixture: L. acidophilus 
+B. bifidum) and (4 strain mixture: L. acidophilus, 2 
strains, B. bifidum, B. animalis) ) were supported by a con- 
firmatory study. Evidence that probiotics may alter or 
improve normal microbiota (model B) was found for 
three single strain probiotics {E. coli Nissle, S. boulardii 
and L. casei rhamnosus) and seven mixtures of 2-7 pro- 
biotic strains. Of these 10 probiotics finding alteration of 
the microbiota, only three had multiple trials: S. boular- 
dii, a four strain mixture (2 strains of L. rhamnosus+P. 
freudenreichii+B. breve), and a seven strain mixture (4 
lactobacilli and 3 bifidobacteria strains), but only one 
had consistent results showing improvements in the 
microbiota. Clearly, more than one study is needed 
to confirm the impact of a probiotic on the normal 
microbiota. Of the 19 probiotic strains (or mixtures) 
studied in healthy volunteers who were not exposed to 
disruptive factors (model C), no change in the normal 
microbiota was observed for 79%, indicating the robust- 
ness of the microbiota. 

Improvement in the normal microbiota by specific 
probiotic strains seemed to be associated with better 
clinical end points. Within eight common diseases typic- 
ally treated with probiotics, more trials with significant 
efficacy were associated with probiotic strains shown to 
restore the normal microbiota and only one trial with 
significant efficacy was found for probiotics that did not 
alter the microbiota. However, few probiotics had effi- 
cacy trials for all eight diseases and many did not have 
any efficacy trials. 

Some probiotics which have published efficacy trials 
for various diseases did not have studies investigating the 
effect of the probiotic on normal microbiota: B. clausii, 
B. infantis, L. brevis, L. reuteri, mix of two strains (L. acid- 
ophilus+L. helveticus), mix of two strains (L. acidophilus+L. 
casei) or (L. acidophilus+B. animalis), mix of four strains 
(L. rhamnosus (two strains), P. freudenreichii+B. animalis)) 
and mix of seven strains (L. sporogens, L. bifidum, 
L. bulgaricus, L. thermophilus, L. acidophilus, L. casei, 
L. rhamnosus). 

Comparison of results with otiier studies 

Other reviews in the literature of claims for probiotics 
relating to changes in the normal microbiota have 
focused on the broad issues of regulatory standardisation 
of health or function claims, the use of proper study 
designs and the challenge of defining biomarkers for a 

3 29 112 S 

'healthy microbiota'. Donovan et ar recommends 

that health claims for probiotics be supported by well- 
conducted human trials in the targeted population. 
These reviews also recommend that gut biomarkers 
need to be correlated with clinical endpoints, however 
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none of these reviews attempted to do so.^^ No prior 
review has attempted to analyse the association between 
probiotic strains and their impact on normal microbiota 
by stratifying on the quality of study design/ This 
review addressed these concerns by analysing probiotic 
strains by the quality of the study design and only includ- 
ing trials that assessed the normal microbiota (either by 
microbial culturing or molecular strain biomarkers) and 
assessed the degree of dysbiosis improvement with clin- 
ical outcomes for each probiotic strain. 

Opportunities for future research 

Most of the studies (80%) using model A to document 
restoration of the normal microbiota only used micro- 
biological culturing techniques, which can only detect 
those organisms that grow in culture. Use of the more 
advanced molecular metagenomic techniques have 
found that culturing alone misses up to 95% of these 
organisms. The use of the metagenomic techniques 
was more common in the studies using model B (48%) 
and model C (45%) study designs, which only addresses 
potential alteration of the microbiota. Characterisation 
of the microbiota is a complex issue and a comprehen- 
sive accounting of all the bacterial and fungal strains in 
the body is beyond our current capabilities. Therefore, 
any studies of changes to the microbiota are incomplete 
at best, but general trends in bacterial phylotypes can be 
documented using DNA probes and metagenomic tech- 
niques. Differential detection bias may be present due 
to the variety of assays used in these studies and should 
be accounted for in future studies. 

Another suggestion for future studies is to include an 
appropriate follow-up time period postprobiotic adminis- 
tration. Fewer than half of the reviewed trials did assays 
for normal microbiota during an appropriate follow-up 
period. As it has been shown that recovery from a dis- 
rupting factor can be prolonged (typically 8 weeks), ^ ^ 
and studies that failed to find microbiota recovery might 
have detected a return to normal baseline levels if a suf- 
ficiently long time was given for the recovery to have 
occurred. Future studies should strive to allow time for 
the restoration of the normal microbiota to occur. 

As the effects of probiotics are strain specific, and 
many studies typically only report the genus and species 
of the tested probiotic, future reports should include a 
complete description of the probiotic to the stain 
level.^ ''^ 

Strengths and wealcnesses 

The strengths of this review included the completeness 
of the search strategy, which reviewed multiple citation 
databases, trial registries and author searches, use of 
established PRISMA protocols for reviews and the use of 
an outcome classification scheme for different degrees 
of assessment for microbial recovery. This analysis con- 
trolled the confounding effects of different study popu- 
lations and study designs present in the literature. 
Pharmacokinetic studies of just the probiotic strain (s) 



itself were excluded and only trials that assayed other 
species found in the microbiota were included. By apply- 
ing a standard definition for 'restoring' versus 'improv- 
ing' normal microbiota, it is possible to distinguish 
significant differences by the type of study designs used 
and differential effects of the different probiotic strains. 
Limitations of this review include: a single author 
reviewed and extracted the literature, pooling trials from 
different populations (adult vs paediatric) and different 
probiotic doses and regimens used. Incomplete retrieval 
of all studies assessing the effect that probiotics have on 
human microbiota is also a potential limitation of any lit- 
erature search. Another limitation is that dysbiosis 
improvement and clinical efficacy for probiotic strains is 
also indirectly associated, no direct cause and effect rela- 
tionship was possible with the types of studies carried 
out. Another limitation is the current lack of a standard 
definition of what comprises a 'normal microbiota'. The 
constituents of the microbiota vary by individual, by age, 
geographic location and health status of the host. 
Current microbiological techniques are improving, but 
cannot detect all species present in the host. 

CONCLUSION 

The challenges in recommending a specific probiotic to 
patients who need to restore or improve their normal 
microbiota after a disrupting event occurs is twofold: one 
is the diversity of probiotic products available and second 
is the varying strength of evidence provided by clinical 
trials using different outcome measures and study 
designs. By grouping studies into three groups that result 
in three different degrees of probiotic effect (restoration, 
improvement or no change), an overview of the body of 
evidence is possible. By comparing the strength of the 
clinical evidence for common diseases by the degree to 
which the probiotics could impact the restoration of the 
normal microbiota, it became obvious that those probio- 
tics with a greater ability to restore the microbiota are 
associated with the strongest strength of clinical efficacy. 
While this evidence only indirectly links clinical efficacy 
with the ability to restore the microbiota, the overall 
review of the evidence shows this is an important mech- 
anism of action for probiotics. What becomes obvious is 
that more studies are required to conclude which pro- 
biotic strains have a beneficial impact on the normal 
microbiota, as most strains have only a single clinical trial 
and many probiotic products overstate the strength of 
their claim to restore normal microbiota. These types of 
issues should be considered for healthcare policymakers 
and researchers for future studies and for creating guide- 
lines for health/function claims. 
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